Batch & Instance Normalization
Batch Normalization
Instance Normalization
Batch Normalization is designed for gradient vanishing and covariance shift.
It makes a batch of input normalize to Gaussian distribution.
Instance Normalization is 1 sample independent across batch version of batch normalization.